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Abstract 

We study complex networks with weights, Wij, associated with each Unk connecting node i and 
j. The weights are chosen to be correlated with the network topology in the form found in two 
real world examples, (a) the world-wide airport network, and (b) the E. Coli metabolic network. 
Here wij ~ Xij{kikj)°', where ki and kj are the degrees of nodes i and j, Xij is a random number 
and a represents the strength of the correlations. The case a > represents correlation between 
weights and degree, while a < represents anti-correlation and the case a = reduces to the case 
of no correlations. We study the scaling of the lengths of the optimal paths, £opt, with the system 
size N in strong disorder for scale- free networks for different a. Wc find two different universality 
classes for £opt in strong disorder depending on a: (i) if a > 0, then for A > 2 the scaling law 
^opt ~ N^^^, where A is the power-law exponent of the degree distribution of scale-free networks, 
(ii) if a < 0, then £opt ~ N''°p* with Uopt identical to its value for the uncorrelated case a = 0. We 
calculate the robustness of correlated scale-free networks with different a, and find the networks 
with a < to be the most robust networks when compared to the other values of a. We propose an 
analytical method to study percolation phenomena on networks with this kind of correlation, and 
our numerical results suggest that for scale-free networks with a < 0, the percolation threshold, 
Pc is finite for A > 3, which belongs to the same universality class as a = 0. We compare our 
simulation results with the real world-wide airport network, and we find good agreement. 

PACS numbers: 89.75.Hc 
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I. INTRODUCTION 



Recently attention has focused on the topic of complex networks, which characterize 



many natural and man-made systems, such as the internet, air 



ine transport system, power 



Network structure 



grid infrastructures, biological and social interaction systems 
systems are visualized by nodes representing individuals, organizations, or computers and 
by links between them representing their interactions. Significant topological features were 
discovered, such as the clustering and small- world properties 1^]. There exists evidence that 
many real networks possess a scale-free (SF) degree distribution characterized by a power 
law tail given by V{k) ~ k~^, where k is the degree of a node and A measures the broadness 
of the distribution [5J. In most studies, all links or nodes in the network are regarded as 
identical. Thus the topological structure of the network determines all the other properties 
of the network, such as robustness, percolation threshold ^Q], the average shortest path 
length, ^min fsl and transport ^. 

In many real world networks the links are not equally weighted. For example, the links 
between computers in the Internet network have different capacities or bandwidths and the 
airline network links between different pairs of cities have different numbers of passengers. To 
better understand real networks, several studies have been carried out on weighted network 



models 



liQ, n, 3, 13, 14, 3,Q,HQ,Q 



For weighted networks, an important quantity 



that characterizes the information flow is the optimal pa th, which is the path that minimizes 



the total weight along the path 



iU now IS tne optimal pe 

0,00,0,0,0 



2l|. Optimal paths play important 



roles in many dynamic systems such as current flow of random resistor networks, where the 



m 



19|. The above 



dynamics of current flow is strongly controlled by the optimal path 
studies assume that the weights on the links are purely random — i.e. uncorrelated with 
the topology of the network. 

However, recently several studies on networks with weights on the links, such as the 



bohc networks ml M show 



2j. For the WAN, each link 



world-wide airport networks (WAN) and the E. coli meta 
that the weights are correlated with the network topology 
is a direct flight between two airports i and j and the weight Wij is the number of passengers 
between them during a period of time. The mean traffic on links can be characterized by: 
(Tij) ~ {kikjY , where ki and kj are the degrees of nodes i and j and ^ > 0]. 

In this paper, we study how the correlations between the topology and the weights affect 
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the robustness, the percolation threshold, the scaling of the optimal path length and the 
minimum spanning tree b y st udying the weighted SF model. The WAN was found to be 



a SF network with A 



22l |. We model the dynamic transport process of the WAN as a 



SF network with correlated weights representing the number of passengers |22]. We study 
robustness and scaling of the optimal paths and find good agreement with the real WAN 
results. 



II. NETWORKS WITH TOPOLOGICALLY CORRELATED WEIGHTS 
A. Network model with topologically correlated weights 

In studies on weighted networks such as the WAN and E. Coli metabolic network, the 
weights on the links represent different quantities. The weight in E. Coli metabolic network 
represents the flux of a link, which represents the relative activity of the reaction on that 
link 1231]. For both real networks, the weight associated with a link measures the preference 
level of that link. The higher the weight is, the easier it is to go through that link. In 
the sense, the inverse of the weight on both networks is actually a plausible evaluation of 
the "cost" to traverse that link. In the WAN, the "cost" includes the airfare, time and 
convenience, etc. We assume that the higher is the cost on a link, the less traffic it has. 

From this perspective, we apply the optimization problem [l7| to the SF network with 
generalized correlated weight. To each link connecting a pair of nodes i and j in a SF 
network we assign a weight Wij, representing the cost to transverse that link, with the form: 

Wij = Xijikikj) , (1) 

where Xij is a random number, a is a parameter that controls the strength of the correlation 
between the topology and the weight and fcj, kj is the degree of node i and node j. The 
random number x,,- could be chosen to mimic the statistical distribution of the real network 

n 

and in this paper Xij is taken from a uniform distribution between and lj25||. Here we will 
be interested in the entire range of a. 

The minimum spanning tree (MST) of SF networks with correlation of Eq. (^J represents 
the structure carrying the maximum total traffic in real WAN network and the skeleton of the 
most used paths in E. Coli metabolic network. The MST is the tree spanning all nodes of the 
network with the minimum total weight. With weights according to Eq. (Q) and a = —0.5, 
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the MST is the same as the tree that maximizes the total traffic out of all possible spanning 
trees of the WAN network because the structure of the MST is only determined by the 
relative order of the links according to the weight, which is preserved under the inverse 
transformation. For this reason, in our simulation, we only show results for a = 1,0,-1 
representing a > 0, a = and a < [24, 26 1. As an optimized tree, the MST playing the role 
of the network skeleton, is widely used in different fields, such as the design and operation of 



communication networks, the traveling salesman 



problem, t 



le protein interaction problem. 



optimal traffic flow and economic networks j2^ |27|, |28|, |29|, |30|, |31|, |3^ . Thus studying the 
effect of correlations of the type of Eq. (0) on the structure of the MST may explain the 
transport on such weighted networks and possibly will lead to better understanding of the 
origin of such correlations in real networks. Moreover, the MST is the union of all the 
optimal paths in strong disorder (SD) limit [2^, where one link on a path dominates the 
total weight of the path. Thus, the scaling of the optimal paths also reveals an important 
aspect of the structure of the MST. 



B. Scaling of the length of the optimal path 



0. 



The case a = represents the uncorrelated case, which is studied in Ref [13]- In the SD 
regime, the total weight of a pat h is controlled by a single link with the highest cost on that 
path [l5|, |l6|, |l7|, |l8|, |l9|, |20|, |21[ . For uncorrelated SF networks, the length of the optimal 
path in SD, iopt scales with as 



3: 



A^^°p» A > 3 

(2) 

In^-i A^ 2 < A < 3, 

with z/opt = 1/3 for A > 4 and i/opt = (A - 3)/(A - 1) for 3 < A < 4. 

From the definition of the weights (see Eq. (P)), in the case a 7^ 0, we expect that 
correlations will affect the links connected to the high degree nodes (hubs). The optimal 
paths behave either as ^^hub-phobic" or as ^^hub-philic" depending on whether a is positive 
or negative. Hub-phobic {a > 0) means that the optimal paths dislike to go through hubs 
because the cost is higher. Hub-philic {a < 0) means that the optimal paths like to go 
through hubs because they cost less. Thus a is a parameter controlling the importance 
level of hubs in the optimized transport process. Due to the importance of the hubs in SF 
networks, we expect that the scaling of i^pt will be affected by such correlations. We expect 



in the hub-phobic regime, that the optimal paths should be topologically similar to an ER 
graph ^^l; where there are almost no hubs. Thus iopt will scale with with exponent 1/3 as 
in ER networks [17] for all the values of A > 2. On the other hand, in the hub-philic regime, 
the hubs are preferred and the optimal paths will avoid small or intermediate degrees, which 
are less important for the SF networks and have minor influence on the optimal paths. Thus 
in this case we expect that iopt will scale similarly to the uncorrelated case. 

The SD limit can be reached by approaching absolute zero temperature if passing 
through a link is regarded as an activation process with a random activation energy Sij 
and Wij = exp{(3eij), where (3 is the inverse temperature, since for /? ^ oo a single link in 
the path dominates the sum J^'^ij along the path. For a general form of weight, which is 
not exponential but rather such as Eq. ([Q), the SD limit can be reached by generating the 
MST because it provides the optimal path between any two nodes of a network in the SD 
limit 13]. In this paper, we use the MST to compute the optimal paths in the SD limit. 

To model the WAN, we generate the SF networks using the MoUoy-Reed algorithm with 
the constraint of disallowing parallel links (two or more links connecting the same two nodes) 

nn 

and self-loops (node connecting with itself) Then for each link ij in the network, 

we assign a weight according to Eq. ([T)). 

We build the MST on the largest connected component of a graph using Prim's algo- 
rithm js^. The tree starts from any node in the largest connected component and grows 
to the nearest neighbor of the tree with the minimum cost. This process ends when the 
MST includes all the nodes of the largest connected component. This process is analogous 
to mva.on percolation used in phy.c. U As tlte MST . a t.ee. there .only a .ngle path 
between any pair of nodes, which is the optimal path in the SD limit [20||. 

An equivalent algorithm to find the MST is the "bombing algorithm" jisl. [l7|. where we 
start with the full network and remove links in descending order of the weight only when 
the removal of a link does not disconnect the graph. The algorithm ends, and the MST is 
obtained, when no more links that can be removed without disconnecting the graph. Then 
we calculate the mean value of £opt between a pair of randomly chosen nodes and average 
over many pairs and many realizations. 

Figure H (a) shows £opt as a function of N^^^ for several values of A > 2 with a = 1. The 
linear behavior supports the expected scaling for the SF networks in the hub-phobic regime 
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(a > 0): 

4pt~iVV3 [A>2,a>0]. (3) 

Eq. (jS)) supports our hypothesis that if the hubs are dynamically avoided, the SF networks 
behave the same as an ER networks. 

In the hub-philic regime (a < 0) , we find that iopt scales the same as for the uncorrelated 
case (a = 0). In Figs. [T] (b), (c) and (d), we plot the scaling behavior of i Opt R function 
of according to the scaling found for the uncorrelated case Our numerical results 
suggest that the scaling behavior of iopt in the hub-philic regime has the same scaling form 
of Eq. (j2)) as the uncorrelated case. However, in the hub-philic regime, £opt is much smaller 
than that of the uncorrelated case, which shows the advantage for the optimal paths to pass 
through the hubs. 



C. Robustness 



Percolation properties of random networks with given degree distributions have been 
extensively studied 



37 



38|. One of the most striking results j^], due to its impor- 



tant implications, is the absence of a percolation threshold in the uncorrelated random SF 
networks with A < 3. In other words, in this type of network, one has to remove almost 
all nodes before the network collapses into disconnected components because the few hubs 
always keep the remaining network connected |6|. Translated into the epidemic context, it 
means that an epidemic threshold below which the epidemics cannot propagate approaches 
zero as ^ oo. 

Robustness of a network can be characterized by the fraction of the links or nodes one has 
to remove in order to disconnect the whole network. Nevertheless, almost all the analytical 
results on robustness obtained up to now implicitly refer to uncorrelated networks and little 
is known about the effects of topologically correlated weights on the percolation properties 
of networks. To test the robustness in weighted correlated networks, we calculate the ratio 
Poo = {S)/N as a function of q, where (S) is the average mass of the largest remaining 
cluster, is the mass of the whole network and q is the fraction of removed links. Poo 
basically is the probability to find a node belonging to the giant component. In order to 
compute Poo after building the network, we assign weights on links according to Eq. ([[]). 
Then we remove a fraction q of links in descending order of weights and calculate Poo through 
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{S)/N. In order to identify the percolation threshold pc = 1 — Q'c we compute also the average 
mass of the second largest component (5*2), and estimate qc from its maximum value 3^. 

In Figure |21 we show the results for networks with N = 8192 and different values of A 
and a. The peak of (5*2) indicates the position of Pc{N). We can see that for uncorrelated 
case (a = 0), as expected Pc{N) is close to zero for A = 2.5. In the hub-phobic (a > 0) 
regime, Pc{N) is always finite as expected due to its topological similarity with ER networks. 
However, in the hub-philic regime {a < 0), firstly we observe that the Pc{N) is always 
smaller than uncorrelated case, which means that networks with a < are more robust 
than uncorrelated ones. Secondly, Pc{N = 8192) in the hub-philic regime {a < 0) is very 
close to zero even for A = 3.5, which suggests that Pc{oo) might be zero. This is very unusual 
because it is known that in the uncorrelated case, Pc{oo) is finite for A > 3 j6|. A similar 
behavior Pc{N) close to zero is obtained for a < and 3 < A < 4. Thus, for these values 
of A, the case of the hub-philic regime might correspond to a new universality class. This 
question will be discussed in Sec. Ill Dl 

Robustness is directly related to the attacking and immunization strategies. The cal- 
culations in Fig. 121 show the robustness of networks against attacks according to the link 
weights. There are other types of non-random attacking strategies such as: {Strategy I): 
intentionally attacking node according to its degree [ssl. Isgj]: {Strategy IT): intentionally at- 
tacking links according to its weight in the SF network at the hub-phobic regime (a > 0). It 
was found that Strategy lis an efficient way of attacking a SF network [s^^]. For strategy 
II, in the hub-phobic regime, the links connecting to hubs will be attacked first. Next we 
compare the efficiency of these two types of intentional attack strategies. To fairly compare 
the two strategies, we calculate Pqo of both intentional attack strategies as a function of q, 
the fraction of removed links. For Strategy I, attacking a node is equivalent to attack all 
the links of that node. In Fig. El we see that these two strategies are similar to each other. 
Comparing the position of qc for these two strategies, we can conclude that Strategy II is 
actually slightly more efficient than Strategy I. 

From Fig. El (a) we can see that 

Pc{a = -1) <pc{a = 0) <pc{a = l), (4) 
a result which is not surprising because as a increases more central links connecting high 
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degree nodes are removed. A surprising result is that 



Poo(a = 1) > Poo{a = 0) > P^{a = -1) (5) 

for a wide range of q values, e.g., for A = 2.5 below 0.7. This is probably due to the 
fact that when removing central links connecting high degree nodes the remainin g ne twork 
does not become disconnected as shown in the study of the k-core of networks 40|. The 
effect of removing those central links is mostly to increase the distance. 

To test our hypothesis we calculate the average length of the shortest path £min of the 
largest cluster as a function of q for the 3 different correlation cases. In Fig. 0] (a) we plot 
(^min) as function of q. We can see that 

(^min)Q=l ^ (^min)a=0 ^ (^min)Q!=— 1 (6) 

for a wide range of q as predicted. The peaks for a = 1 and a = are at the same position 
as the corresponding q^ of Fig. |21 (d) because when q > qc the whole network is fragmented. 
We compute (^min) also for the real WAN network and obtain similar results (See Fig. HI (b) 
and Sec. IIIII). 



D. Percolation analysis of correlated scale- free networks 

An important question is whether for a < and 3 < A < 4, Pc{oo) is zero. In simulations 
we observe that Pc{oo) is incredibly close to zero for 3 < A < 4. However, it might be a 
result of finite size effects and pc is indeed very close to zero but not zero. To further test 
this possibility, we propose the following analytical method. 

Near pc, the structure of the giant component is like a tree. The giant component at the 
percolation threshold can be viewed as a growing process of a tree. Assuming that at some 
layer, the number of nodes with degree k is n{k), then the number nodes of degree k' at the 
next level n{k') satisfies 

n{k')=j:n{k){k~l)^^^<j>{k',k), (7) 

where (j){k', k) is the probability that a node with degree k is connected to a node of degree 
k'. Here we are interested in the hub-philic regime {a = —1). Since we remove the links 
in descending order, we can assume that any link with weight above 1/c are cut. The links 
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left are only links with weights below 1/c, which is represented by the condition kk' > c. 
Eq. ((Tj) can be therefore simplified to 

nik')= £ n{k){k-l)^^. (8) 

k=c/k' \ ' 

The dimension of the vector n{k) is actu ally the maximum degree fcmax- For a SF network 



with system size A^, /cmax ~ A^V(->*-i) |41|. Thus controlling, fcmax, the dimension of the 
vector n{k) is actually equivalent to controlling the system size N. For a fixed fcmax? if 
Eq. (jS)) has at least one eigenvalue that is above 1, the giant component will grow to infinity, 
which means it is above pc, on the other hand, if all of the eigenvalues are below 1, the 
system is below pc. We basically change the c value and compute the normal of vector n{k) 
recursively, and find the critical c value, c*, at which the normal of vector n{k) changes from 
converging at c* to diverging at c* + 1. Thus, from the definition of percolation, Pc{N) can 
be numerically calculated using the relation 

f kk'V{k)V{k') „ 
Pc{N) = / ) ( ^ ' dkdk'. 9 

Jkk'>c* {k}^ 

If c*(A;max) diverges as fcmax oo, from Eq. Q follows that Pc{oo) is zero. Otherwise, Pc{oo) 
is finite. Thus, we convert the question of whether Pc{oo) is zero for 3 < A < 4 into the 
question of whether c*(A;max) diverges with /cmax- 

Figure El shows numerical results of c*(fcmax) as fcmax increases. It shows that for A < 3, 
c* grows with fcmax as a power law, which confirms that when A < 3, Pc{oo) is zero Qj. 
However, for 3 < A < 4, Fig. Efb) suggests that the successive slopes of Inc* versus Inkmax 
approach zero for 3 < A < 4, which indicates a finite Pc{oo) when 3 < A < 4. We can see 
the strong finite size effect from Fig. , where the convergence of c* for A = 3.5 happens 
only for k^ax > 10^ corresponding to ~ fc^"^ > 10^°, which we are not able to reach in 
simulations with present computing power. 

III. THE IMPACT OF THE HUB-PHILIC CORRELATION ON REAL WORLD 
NETWORKS 

Real world networks such as the WAN and the E. Coli metabolic network are found to 



have a hub-philic type correlation (a = —0.5) 22; |23|, |2J| . Using WAN as an example, the 



passengers tend to go through the large airports, which actually shortens and optimizes the 
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transport performance of the entire WAN network. Our simulations show the advantage of 
networks in the hub-phihc regime over uncorrelated networks from the perspective of the 
optimal paths in the SD regime (see Fig. ^ (b)-(d)). Also they show that networks in the 
hub-philic regime are also more robust than uncorrelated networks (see Fig. |2I). Real WAN 
have only one value of a = —0.5, so to see the effect of different a on the real WAN network, 
we use the following method. Assigning the weights according to Eq. (^, we first compute 
xJI*^', the value of x^- from the real weight of WAN. Thus we leave a as a parameter and 
we can change its value to get either the hub-philic or the hub-phobic regime. In this case, 
when a = —0.5, the weight is the same as in the original WAN network. 

Figure ini compares the robustness calculations (see also Fig. |21 (a) and (d)) of our model 
with the real WAN. From the calculation of both the largest and second largest clusters, we 
can see that the real WAN networks have behavior similar to our model. Notice that Fig. IHl 
(a) shows a = —0.5 is more robust than a = —1, which shows the advantage of a = —0.5 in 
the real WAN Q- 

The second largest cluster calculation (see also Fig. IHl (b)-(d) and Fig. |2l 
(d)) indicates where the pc is, we see the WAN and our model are surprisingly similar. 

To compare the optimal paths between the real WAN and our model, we calculate (^opt) 
as a function of imm- Figure [7| shows the simulation results for the SF model and for the 
real WAN (Fig. [7| (b)). We observe that for a < 0, (^opt) is almost the same as imm because 
in the hub-philic regime the optimal paths tend to go through the hubs, which shortens the 
length of the optimal paths. In the hub-phobic regime {a > 0), the optimal paths tends 
to avoid the hubs, which naturally generate large length of the optimal paths. We also see 
that in both the real WAN and the model for a > 0, and for short £min, (^opt) increases 
sharply, while for large imin, (^opt) increases weakly with fmin- This is probably related to 
the crossover from strong disorder in short length scales to weak disorder in large length 
scales that was observed in several earlier studies 



IV. CONCLUSIONS 



We propose a model of networks with correlated weights (Eq. ([H)) motivated by studies 



of the WAN and E. Coli metabolic networks 
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2J]. In our model, there are three regimes 



according to the value of the parameter a: the hub-philic regime (a < 0), the hub-phobic 
regime (a > 0) and the uncorrelated regime (a = 0). We study the properties of the optimal 
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path and find two universality classes for the length of the optimal path iopt- (i) For networks 
in the hub-phobic regime (a > 0), the optimal path on SF networks with any A > 2 behaves 
the same as the optimal path in ER networks, (ii) For a < 0, the optimal paths in SF 
networks belongs to the same universality class as the optimal path in SF networks with 
uncorrelated weights. 

We also calculate the robustness of the SF networks of our model and find that SF 
networks in the hub-philic regime are more robust compared to SF networks in the other two 
regimes. We propose an analytical method to study the percolation transition of networks 
with weights of Eq. ((H) and the numerical results suggest that the Pc(oo) of networks in the 
hub-philic regime, although close to zero, is not zero for 3 < A < 4. We also observe strong 
finite size effects for SF networks in the hub-philic regime. 

In the last section, we compare the simulation results based on our model with the actual 
WAN network. We calculate the (-^opt) for two nodes separated with fixed distance i^i^i and 
observe similar behaviors and the crossover from strong disorder to weak disorder for both 
our model and the real WAN. We also compare the results of the robustness calculation of 
our model with the real WAN network and find good agreement. 
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use 9 to represent the correlation pa- 



but here we focus on SF networks. Reference 
rameter. a in Eq. is analogous to —6. So the corresponding a value for real networks such 
as the WAN and the E. coli are negative, with a = —0.5 for both. 
[26] From the definition and the algorithm for the MST, only the relative order of the links ac- 
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FIG. 1: (4pt) as a function of (a) N^^, (b) In^^'^) N, (c) Ar(^-3)/(^-i) jyi/s gj) ^j. ^^^^ 

a = 1 with: A = 5 (Q), A = 3.5 (□) and A = 2.5 (O); (b) A = 2.5 with: a = (A) and a = -1 
(y); (c) A = 3.5 with: a = (A) and a = -I (y) and (d) A = 5.0 with: a = (A) and a = -1 
(V)- 
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FIG. 2: Left column (a)-(c): as a function of g, the concentration of removed links with (a) 
A = 2.5, (b) A = 3.5 and (c) A = 4.5. Right column (d)-(f): {S2)/N as a function of q with (d) 
A = 2.5, (e) A = 3.5 and (f) A = 4.5. 
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FIG. 3: Poo as a function of q with (a) A = 2.5, (b) A = 3.5 and (c) A = 4.5 for Strategy I {Q): 
attacking nodes according to degree of nodes and Strategy II (solid line): attacking links according 
to its weight for the SF networks in the hub-phobic regime (a > 0). 
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FIG. 4: (a) (^min)! the average length of the shortest path as a function of q, the concentration of 
removed links in descending order of the weight for simulated SF networks with a = 1 {O), a = 
(□) and a = —1 (O). (b) The same calculation for the real WAN network with a = 1 (solid line), 
a = (dotted line), a = —0.5 (dot-dashed line) and a = — 1 (dashed line). 
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FIG. 6: (a) 

Poo SiS a function of q, the concentration of removed links in descending order of the 
weight for our model with A = 2.5 (symbols) and the real WAN (lines). For model: a = 1 {Q>), 
a = (□) and a = -1 (O). For the WAN network: a = 1 (solid line), a = (dotted line), 
a = —0.5 (dot-dashed line) and a = — 1 (dashed line), (b)-(d) {S2)/N as a function of q for our 
model with A = 2.5 (symbols) and the real WAN (solid lines) with (b) a = 1, (c) a = and (d) 
a = —1. 
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FIG. 7: (a) Plot of (^opt) as a function of £mm for our model of correlated weighted SF network 
with A = 2.5, in the SD limit (Q), a = 2 (□), a = 1 {O), a = (A) and a = -1 (<). (b) Same 
plot as in (a) for the real WAN network with a = 1 (O), a = (□), a = —1 (O) and a = —0.5 
(A). 
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